The Health Education Impact Questionnaire (heiQ): An outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions

Objective: This paper describes the development and validation of the Health Education Impact Questionnaire (heiQ). The aim was to develop a user-friendly, relevant, and psychometrically sound instrument for the comprehensive evaluation of patient education programs, which can be applied across a broad range of chronic conditions.

Methods: Item development for the heiQ was guided by a Program Logic Model, Concept Mapping, interviews with stakeholders and psychometric analyses. Construction (N = 591) and confirmatory (N = 598) samples were drawn from consumers of patient education programs and hospital outpatients. The properties of the heiQ were investigated using item response theory and structural equation modeling.

Results: Over 90 candidate items were generated, with 42 items selected for inclusion in the final scale. Eight independent dimensions were derived: Positive and Active Engagement in Life (five items, Cronbach's alpha (α) = 0.86); Health Directed Behavior (four items, α = 0.80); Skill and Technique Acquisition (five items, α = 0.81); Constructive Attitudes and Approaches (five items, α = 0.81); Self-Monitoring and Insight (seven items, α = 0.70); Health Service Navigation (five items, α = 0.82); Social Integration and Support (five items, α = 0.86); and Emotional Wellbeing (six items, α = 0.89).

Conclusion:The heiQ has high construct validity and is a reliable measure of a broad range of patient education program benefits.

Practice Implications: The heiQ will provide valuable information to clinicians, researchers, policymakers and other stakeholders about the value of patient education programs in chronic disease management.

A systematic review of outcomes of chronic disease self-management interventions

Purpose
To carry out a systematic review of program outcomes used in the evaluation of group-based self-management interventions aimed at people with arthritis and other chronic conditions.

Methods
The systematic search was performed across databases MEDLINE, EMBASE, CINAHL, and PsycINFO. Both between-group and within-group effect sizes (ES) were calculated. Results were interpreted as small (ES ~ 0.2), medium (ES ~ 0.5), or large (ES ~ 0.8) effects.

Results
The majority of 18 included trials investigated the effectiveness of arthritis-specific interventions. Across most outcomes, small effects on course participants were shown. While effects on knowledge were large (between-group ES = 0.78), effects on clinical outcomes such as pain (ES = 0.10) were negligible to small.

Conclusions
This paper is consistent with other reviews in this area, suggesting that people with arthritis receive only marginal benefits from participating in chronic disease self-management interventions. When looking at the types of outcomes that trials are based on, however, alternative explanations for these results seem probable. As evaluations heavily rely on patient self-report, current approaches to program evaluation may not be sufficient to assess the intended impact of self-management education. An in-depth investigation of the types of outcomes assessed is provided in a separate paper.

The effectiveness of mobile-health behaviour change interventions for cardiovascular disease self-management: a systematic review

BACKGROUND: Mobile wireless devices (mHealth) have been used to deliver cardiovascular disease self-management interventions to educate and support patients in making healthy lifestyle changes. This systematic review aimed to determine the effectiveness of mHealth interventions on behavioural lifestyle changes and medication adherence for cardiovascular disease self-management. METHODS: A comprehensive literature search was conducted from inception through to 3 March 2015 using MEDLINE, PubMed, PsycINFO, EMBASE and The Cochrane Library. Eligible studies used an experimental trial design to determine the effectiveness of an mHealth intervention to change lifestyle behaviours in any cardiovascular disease population. Data extracted included intervention and comparison group characteristics with a specific focus on the use of behaviour change techniques. RESULTS: Seven studies met our inclusion criteria and were included in the qualitative synthesis. All interventions were delivered in part by mobile phone text messaging. Three studies were effective at improving adherence to medication and two studies increased physical activity behaviour. No effects were observed on dietary behaviour or smoking cessation, measured in one study each. Simple text messaging interventions appeared to be most effective; however, no clear relationships were found between study findings and intervention dose, duration or behaviour change techniques targeted. CONCLUSIONS: Our review found mHealth has the potential to change lifestyle behaviour. Results are still limited to a small number of trials, inconsistent outcome measures and ineffective reporting of intervention characteristics. Large scale, longitudinal studies are now warranted to gain a clear understanding of the effects of mHealth on behaviour change in the cardiovascular disease population.

Measurement issues in the evaluation of chronic disease self-management programs

Objectives: 

Self-management programmes in stages 1–4 chronic kidney disease: a literature review

Background
Chronic kidney disease (CKD) is a complex health problem, which requires individuals to invest considerable time and energy in managing their health and adhering to multifaceted treatment regimens.

Objectives
To review studies delivering self-management interventions to people with CKD (Stages 1–4) and assess whether these interventions improve patient outcomes.

Design
Systematic review.

Methods
Nine electronic databases (MedLine, CINAHL, EMBASE, ProQuest Health & Medical Complete, ProQuest Nursing & Allied Health, The Cochrane Library, The Joanna Briggs Institute EBP Database, Web of Science and PsycINFO) were searched using relevant terms for papers published between January 2003 and February 2013.

Results
The search strategy identified 2,051 papers, of which 34 were retrieved in full with only 5 studies involving 274 patients meeting the inclusion criteria. Three studies were randomised controlled trials, a variety of methods were used to measure outcomes, and four studies included a nurse on the self-management intervention team. There was little consistency in the delivery, intensity, duration and format of the self-management programmes. There is some evidence that knowledge- and health-related quality of life improved. Generally, small effects were observed for levels of adherence and progression of CKD according to physiologic measures.

Conclusion
The effectiveness of self-management programmes in CKD (Stages 1–4) cannot be conclusively ascertained, and further research is required. It is desirable that individuals with CKD are supported to effectively self-manage day-to-day aspects of their health.

Patient self-management in chronic heart failure – establishing concordance between guidelines and practice

 Chronic heart failure (CHF) is a progressive and debilitating disease with a broad symptom profile, intermittently marked by periods of acute decompensation. CHF patients are encouraged to self-manage their illness, such as adhering to medical regimens and monitoring symptoms, to optimise health outcomes and quality of life. In so doing, patients are asked to collaborate with their health service providers with regard to their care. However, patients generally do not self-manage well, even with specialist support. Moreover, self- management interventions are yet to demonstrate morbidity or mortality benefits. Social network approaches to self-management consider the availability and mobilisation of all resources, beyond those of only the patient and healthcare providers. Used in conjunction with e-health platforms, social network approaches may offer a means by which to optimise self-management programmes of the future.

Adaptation and validation of the Japanese version of the health education impact questionnaire (heiQ-J) for the evaluation of self-management education interventions

Aim:  

Change of perspective: a measurable and desired outcome of chronic disease self-management intervention programs that violates the premise of preintervention/postintervention assessment

Objective: To determine if participants in chronic disease self-management courses have a change of perspective of their health status (a response shift), and if this is measurable with a paper-based questionnaire.

Methods: Nine items were developed to measure potential benefits of self-management courses. These were based on the constructs of a previous questionnaire, the Health Education Impact Questionnaire (HEI-Q). Cognitive interviews elicited spontaneous statements about the reasons for paper-based answers. Sensitivity, specificity, and overall accuracy of items were calculated using the interview as a relative gold standard. Response shift can be negative (i.e., after the course, participants realize that, before the course, they were worse than they thought they were), positive (i.e., participants now realize they were better than they thought they were), or absent (no change).

Results: Interviews (n = 39) reflected that true response shift occurred in approximately half the replies to questionnaire items. Of these, 31% were negative response shift, 20% were positive response shift. Response shift was absent in 32% of replies. Presence or absence of response shift could not be determined in 17% of replies across items. Significant concordance between questionnaires and cognitive interviews (average overall accuracy 0.79) indicated that the HEI-Q Perspective questionnaire detects response shift in participants of self-management courses. The questionnaire revealed that 87% of participants had response shift in at least 1 item.

Conclusion: This study suggests that preintervention/postintervention assessments of interventions such as self-management courses are confounded by a change in perspective of a large proportion of respondents. It also indicates response shift is a valuable outcome of self-management courses that can be measured with a paper-based questionnaire.

Getting your life back on track after stroke : a phase II multi-centered, single-blind, randomized, controlled trial of the Stroke Self-Management Program vs. the Stanford Chronic Condition Self-Management Program or standard care in stroke survivors

Background Self-management is seen as a primary mechanism to support the optimization of care for people with chronic diseases such as symptomatic vascular disease. There are no established and evidence-based stroke-specific chronic disease self-management programs. Our aim is to evaluate whether a stroke-specific program is safe and feasible as part of a Phase II randomized-controlled clinical trial.
Methods Stroke survivors are recruited from a variety of sources including: hospital stroke services, local paper advertisements, Stroke South Australia newsletter (volunteer peer support organization), Divisions of General Practice, and community service providers across Adelaide, South Australia. Subjects are invited to participate in a multi-center, single-blind, randomized, controlled trial. Eligible participants are randomized to either;
• standard care,
• standard care plus a six week generic chronic condition self-management group education program, or,
• standard care plus an eight week stroke specific self-management education group program.
Interventions are conducted after discharge from hospital. Participants are assessed at baseline, immediate post intervention and six months.
Study Outcomes The primary outcome measures determine study feasibility and safety, measuring, recruitment, participation, compliance and adverse events.
Secondary outcomes include:
• positive and active engagement in life measured by the Health Education Impact Questionnaire,
• improvements in quality of life measured by the Assessment of Quality of Life instrument,
• improvements in mood measured by the Irritability, Depression and Anxiety Scale,
• health resource utilization measured by a participant held diary and safety.

Conclusion The results of this study will determine whether a definitive Phase III efficacy trial is justified.

Acceptability, impact and sustainability of the national pilot quality assurance system for self management programs

Chronic condition self-management education and training interventions such as the Stanford Self Management Programs (SMP) have the capacity to improve health and quality of life of people with chronic conditions whilst reducing the use of health services. This is in line with the outcomes from the recent Council of Australian Governments’ meeting where it was indicated that self-management will be a centrepiece in forthcoming chronic disease initiatives.
Aim: report on a large national pilot quality assurance program involving the implementation and of an evaluation and quality monitoring system for SMPs including the provision of structured feedback to courses course leaders and service providers. During 2005/06 the quality assurance program was implemented at 11 diverse organisations across Australia. The program involved assisting organisations apply the 42-item Health Education Impact Questionnaire (HEIQ), a chronic disease health education outcome measure, and then observe and evaluate the value and impact of the quality program. Interviews with course leaders (n=60) and course participants (n=35) have elicited views about course quality and feedback processes.
Results: The evaluation revealed enablers and barriers to effective implementation and sustainability. Important enablers were:
- Course Leaders and organisations valued an Australia-wide system that provided feedback on course
quality and the impact on participants.
- Course Leaders were strongly personally motivated to respond appropriately to HEI-Q course
report feedback.
- Completing the questionnaire provided participants with the opportunity to reflect on issues that
emerge in the course content and reflect on their progression at the end of the SSMP.
Sustainability issues included:
- Organisations and course leaders require support, training and flexibility on how to administer and
manage the use of the HEI-Q.
- Availability of administrative resources in organisations to support the quality assurance activities.
- The requirement that course leaders are trained in interpreting HEI-Q course report data.
A quality improvement framework was developed which identified the actions required of key stakeholders to
support effective implementation.
Discussion: With the increasing endorsement of SMP across sectors it is important that course quality is known, is acceptable, and is communicated to stakeholders to inform and engender confidence in the SSMP. To effectively implement and sustain a quality improvement program for SMP, the processes and tools for measuring outcomes need to be responsive, flexible and easily integrated into the organisation and delivery of programs.

A phase II multicentered, single-blind, randomized, controlled trial of the stroke self-management program

Background and Purpose—The benefits of chronic disease self-management programs for stroke survivors are uncertain because individuals with severe impairments have been excluded from previous research. We undertook a phase II randomized controlled trial to determine whether a self-management program designed for survivors (SSMP; 8 weeks) was safe and feasible compared to standard care (control) or a generic self-management program (generic; 6 weeks).
Methods—Stroke survivors were recruited from 7 South Australian hospitals via a letter or indirectly (eg, newspapers). Eligible participants were randomized at a 1:1:1 ratio of 50 per group. Primary outcomes were recruitment, participation, and participant safety. Secondary outcomes were positive and active engagement in life using the Health Education Impact Questionnaire and characteristics of quality of life and mood at 6 months from program completion.
Results—Of 315 people screened, 149 were eligible and 143 were randomized (48 SSMP, 47 generic, 48 control); mean age was 69 years (SD, 11) and 59% were female. Demographic features were similar between groups and 41% had severe cognitive impairment; 57% accessed the interventions, with 52% SSMP and 38% generic completing >50% of sessions (P=0.18). Thirty-two participants reported adverse events (7 control, 12 generic, 13 SSMP; P=0.3; 34% severe); however, none was attributable to the interventions. Potential benefits for improved mood were found.
Conclusions—SSMP was safe and feasible. Benefits of the stroke-specific program over the generic program included greater participation and completion rates. An efficacy trial is warranted given the forecast growth in the stroke population and improved survival trends.

Positive changes in self-management and disease severity following climate therapy in people with psoriasis

The aim of this study was to investigate the impact of climate therapy on self-management in people with psoriasis. This was a prospective study of 254 adults with chronic psoriasis who participated in a 3-week climate therapy (CT) programme. The 8-scale Health Education Impact Questionnaire (heiQ) was completed at baseline, after 3 weeks of CT, and 3 months later. Change was assessed using paired sample t-tests mean (95% confidence interval) change scores (range 1-4). All heiQ scales showed statistically significant improvement after 3 weeks of CT. The greatest improvement was in Health-directed activity, followed by Emotional distress, and Skill and technique acquisition. At the 3-month follow-up, only the Emotional distress scale remained improved. In addition, disease severity (self-administered PASI; SAPASI) improved significantly from before CT to 3 weeks and 3 months after CT. This study suggests that CT provides a range of benefits that are important to people with psoriasis, particularly in the short term. A challenge is how to achieve long-term benefits.

Text message and internet support for coronary heart disease self-management: results from the text4heart randomized controlled trial

BACKGROUND: Mobile technology has the potential to deliver behavior change interventions (mHealth) to reduce coronary heart disease (CHD) at modest cost. Previous studies have focused on single behaviors; however, cardiac rehabilitation (CR), a component of CHD self-management, needs to address multiple risk factors. OBJECTIVE: The aim was to investigate the effectiveness of a mHealth-delivered comprehensive CR program (Text4Heart) to improve adherence to recommended lifestyle behaviors (smoking cessation, physical activity, healthy diet, and nonharmful alcohol use) in addition to usual care (traditional CR). METHODS: A 2-arm, parallel, randomized controlled trial was conducted in New Zealand adults diagnosed with CHD. Participants were recruited in-hospital and were encouraged to attend center-based CR (usual care control). In addition, the intervention group received a personalized 24-week mHealth program, framed in social cognitive theory, sent by fully automated daily short message service (SMS) text messages and a supporting website. The primary outcome was adherence to healthy lifestyle behaviors measured using a self-reported composite health behavior score (≥3) at 3 and 6 months. Secondary outcomes included clinical outcomes, medication adherence score, self-efficacy, illness perceptions, and anxiety and/or depression at 6 months. Baseline and 6-month follow-up assessments (unblinded) were conducted in person. RESULTS: Eligible patients (N=123) recruited from 2 large metropolitan hospitals were randomized to the intervention (n=61) or the control (n=62) group. Participants were predominantly male (100/123, 81.3%), New Zealand European (73/123, 59.3%), with a mean age of 59.5 (SD 11.1) years. A significant treatment effect in favor of the intervention was observed for the primary outcome at 3 months (AOR 2.55, 95% CI 1.12-5.84; P=.03), but not at 6 months (AOR 1.93, 95% CI 0.83-4.53; P=.13). The intervention group reported significantly greater medication adherence score (mean difference: 0.58, 95% CI 0.19-0.97; P=.004). The majority of intervention participants reported reading all their text messages (52/61, 85%). The number of visits to the website per person ranged from zero to 100 (median 3) over the 6-month intervention period. CONCLUSIONS: A mHealth CR intervention plus usual care showed a positive effect on adherence to multiple lifestyle behavior changes at 3 months in New Zealand adults with CHD compared to usual care alone. The effect was not sustained to the end of the 6-month intervention. A larger study is needed to determine the size of the effect in the longer term and whether the change in behavior reduces adverse cardiovascular events. TRIAL REGISTRATION: ACTRN 12613000901707; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=364758&isReview=true (Archived by WebCite at http://www.webcitation.org/6c4qhcHKt).

A randomised trial of the Flinders Program to improve patient self-management competencies in a range of chronic conditions : study rationale and protocol

Background: Supporting self management is seen as an important health service strategy in dealing with the large and increasing health burden of chronic conditions. Several types of self-management programs are available. Evidence to date suggests that disease specific and lay-led self management programs provide only part of the support needed for improved outcomes. The Flinders Program is promising as a generic self management intervention, which can be combined with targeted disease specific and lay-led interventions, but it has yet to be evaluated for a range of chronic conditions using a rigorous controlled trial design. This paper gives the rationale for a randomised controlled trial and process evaluation of the Flinders Program of chronic condition self-management in community practice, and details and justifies the design of such a study.Method: The design for a randomised trial and associated process evaluation, suited to evaluation of a complex and behavioural intervention as it is applied in actual practice, is presented and justified.Conclusion: A randomised trial of the Flinders Program is required and a functional design is presented. Results from this trial, currently underway, will test the effectiveness of the Flinders Program in improving patient competencies in self-management of chronic conditions in practice conditions. A process evaluation alongside the trial will explore system, provider and patient factors associated with greater and lesser Program effectiveness.

Text message-based diabetes self-management support (SMS4BG): study protocol for a randomised controlled trial.

BACKGROUND: Addressing the increasing prevalence, and associated disease burden, of diabetes is a priority of health services internationally. Interventions to support patients to effectively self-manage their condition have the potential to reduce the risk of costly and debilitating complications. The utilisation of mobile phones to deliver self-management support allows for patient-centred care at the frequency and intensity that patients desire from outside the clinic environment. Self-Management Support for Blood Glucose (SMS4BG) is a novel text message-based intervention for supporting people with diabetes to improve self-management behaviours and achieve better glycaemic control and is tailored to individual patient preferences, demographics, clinical characteristics, and culture. This study aims to assess whether SMS4BG can improve glycaemic control in adults with poorly controlled diabetes. This paper outlines the rationale and methods of the trial. METHODS/DESIGN: A two-arm, parallel, randomised controlled trial will be conducted across New Zealand health districts. One thousand participants will be randomised at a 1:1 ratio to receive SMS4BG, a theoretically based and individually tailored automated text message-based diabetes self-management support programme (intervention) in addition to usual care, or usual care alone (control). The primary outcome is change in glycaemic control (HbA1c) at 9 months. Secondary outcomes include glycaemic control at 3 and 6 months, self-efficacy, self-care behaviours, diabetes distress, health-related quality of life, perceived social support, and illness perceptions. Cost information and healthcare utilisation will also be collected as well as intervention satisfaction and interaction. DISCUSSION: This study will provide information on the effectiveness of a text message-based self-management support tool for people with diabetes. If found to be effective it has the potential to provide individualised support to people with diabetes across New Zealand (and internationally), thus extending care outside the clinic environment. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry: ACTRN12614001232628 .